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Abstract 

We  investigate  the  stability  of  a  collection  of  systems 
which  are  governed  by  linear  dynamics  and  operate  wi¬ 
der  limited  communication.  We  view  each  system  and 
its  feedback  controller  as  users  on  an  idealized  shared 
network  which  grants  access  only  to  a  few  system- 
controller  pairs  at  any  one  time.  A  communication  se¬ 
quence,  which  plays  the  role  of  a  network  admission  pol¬ 
icy,  specifies  the  amount  of  time  available  for  each  sys¬ 
tem  to  complete  its  feedback  loop.  Using  Lyapunov  the¬ 
ory,  we  give  a  sufficient  condition  for  the  existence  of  a 
stabilizing  communication  sequence  and  show  how  one 
can  be  constructed  in  a  way  that  minimizes  network  us¬ 
age.  Our  solution  depends  on  the  parameters  of  the  un¬ 
derlying  system(s)  and  on  the  number  of  controller-plant 
connections  that  can  be  maintained  simultaneously.  We 
include  simulation  results  illustrating  the  main  ideas. 

1  Introduction 

Over  the  past  decade,  the  rapid  growth  of  communica¬ 
tion  and  network  technologies  has  arguably  been  charac¬ 
terized  by  its  emphasis  on  inf ormation  flow  (the  Internet 
and  mobile  telephony  being  two  of  the  most  prominent 
examples).  At  the  same  time,  the  technologies  responsi¬ 
ble  for  what  one  might  call  “the  connectivity  revolution” 
have  significant  implications  for  the  design,  deployment 
and  control  of  distributed  and  networked  control  sys¬ 
tems,  fueling  recent  interest  in  new  large-scale  systems 
such  as  formations  of  robots,  smart  structures  and  sen¬ 
sor/actuator  networks.  However,  as  we  might  expect 
and  can  observe  experimentally  [6]  in  such  settings,  the 
effectiveness  of  a  control  policy  depends  on  the  commu¬ 
nication  constraints  imposed  by  medium  which  connects 
sensors,  actuators  and  computing  elements  within  a  dis¬ 
tributed  system.  This  fact  separates  networks  which 
mainly  transmit  information  for  Internet-based  appli¬ 
cations,  telephony,  etc,  from  those  whose  “users”  are 
parts  of  a  dynamical  system.  This  important  distinc¬ 
tion  -  sometimes  summarized  in  the  phrase  “networks 
for  control  vs.  control  of  networks”  -  underscores  the 
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long-term  need  for  a  brand  of  control  theory  which  bal¬ 
ances  control  and  communication  considerations. 

This  paper  investigates  the  stability  of  a  collection  of 
control  systems  (assumed  to  be  LTI)  whose  feedback 
loops  are  closed  via  a  shared  network;  the  network  can¬ 
not  accommodate  all  controller-system  pairs  simultane¬ 
ously.  Because  of  the  communication  constraints  thus 
imposed,  the  systems  in  question  become  coupled  to 
one  another,  so  that  their  stability  depends  both  on  the 
choice  of  control  law(s)  and  on  the  allocation  of  time  on 
the  shared  network.  We  want  to  find:  i)  communication 
patterns  which  allow  every  system  to  periodically  (but 
sparsely)  close  its  feedback  loop  in  order  to  maintain 
stability  and  ii)  criteria  for  designing  efficient  commu¬ 
nication  patterns  which  stabilize  the  entire  collection. 

A  number  of  related  works  have  explored  the  effects  of 
communication  constraints  on  control  problems,  includ¬ 
ing  the  relationship  between  practical  stability  of  a  dy¬ 
namical  system  and  the  bit-rate  available  for  feedback 
[11],  control/scheduling  co-design  [3]  and  joint  commu¬ 
nication/control  optimization  problems  [2,  7].  These 
last  works  focus  on  the  use  of  communication  sequences 
for  quantifying  the  amount  of  “attention”  received  by 
the  sensors  and  actuators  of  a  control  system  over  the 
course  of  a  control  task.  A  similar  approach  has  been 
used  to  attack  problems  in  optimal  tracking  [6]  and  LQG 
control  [9]  with  limited  communication.  Recent  works 
which  are  relevant  in  the  present  setting  include  studies 
of  the  effects  of  network  delay  on  the  stability  of  lin¬ 
ear  systems  [10],  algorithms  for  stabilization  of  discrete¬ 
time  systems  under  limited  communication  [7],  analyses 
of  event-driven  asynchronous  dynamical  systems  [5]  and 
switched  systems  (see  [8]  and  references  therein). 

2  LTI  systems  as  users  of  a  shared  network 

Consider  a  collection  of  continuous-time  LTI  systems 

Xi{t)  =  AiXift)  +  BjUift);  i  =  1, ...  ,1V  (1) 

./•,(/)  er,«t;(t)  G  Mm 

whose  open  loop  dynamics  are  unstable.  Each  system 
communicates  with  a  remotely  located  controller  that 


occasionally  transmits  control  signals  over  a  shared  net¬ 
work,  according  to  the  static  state  feedback  law1  u,-(t)  = 
KiXi(t)  (see  Fig.  1).  We  assume  that  the  constant 


Figure  1:  A  collection  of  networked  control  systems 
Gj(s)  =  I(sl  —  Ai)-1  Bi  driven  by  feedback  con¬ 
trollers  K,  via  a  network.  H  denotes  a  zero- 
order-hold  stage.  Only  k  of  N  switches  s;  can 
be  closed  at  any  one  time. 

gains  Kj  are  designed  to  stabilize  (A,;,  ft;)  when  the 
ith  feedback  loop  is  closed  (i.e  Re{\(Aj  +  B,  A',)}  <  0, 
/'  I . V). 

Controller-plant  communication  is  limited  in  the  sense 
that  a  maximum  of  k  <  N  plants  may  close  their  feed¬ 
back  loops  at  any  one  time.  This  could  be  because: 

•  All  systems  are  stabilized  by  a  single  centralized 
controller  which  can  perform  a  limited  amount  of 
computation  per  unit  time,  or  has  only  sufficiently 
many  outputs  to  communicate  with  k  out  of  N 
systems 

•  Each  system  has  its  own  controller,  with  commu¬ 
nication  taking  place  over  a  medium  which  can 
only  accommodate  a  maximum  of  k  “users”  at  a 
time. 

We  are  interested  in  finding  an  ordered  sequence  of  es¬ 
tablishing  and  terminating  communication  between  each 
system  and  its  controller  (as  well  as  the  duration  of 
each  communication)  in  a  way  that  preserves  the  sta¬ 
bility  of  each  system  in  the  collection.  We  assume  that 
the  “shared  network”  is  an  idealized  communication 
medium  which  provides  connectivity  between  a  system 
and  its  controller  in  a  discrete  sense  (on  or  off).  We  will 
not  consider  the  effects  of  network  layers,  random  delays 
or  complications  due  to  packed-based  communication. 

1We  assume  that  continuous-time  state  feedback  is  available, 
although  the  discussion  that  follows  can  easily  be  adapted  for  out¬ 
put  feedback  laws  it,;  =  KiC'iXi  and/or  discrete-time  dynamics. 


For  each  system  we  define  a  binary- valued  function  s,;  : 
M+  — >•  {0,1}  which  indicates  whether  the  ith  feedback 
loop  is  closed  at  t  (s,j(t)  =  1)  or  not  (s,;(f)  =  0).  Each 
system  is  preceded  by  a  zero-order  hold  stage  H  which 
is  activated  when  communication  is  cut  off  (s,;(f)  =  0) 
and  “resets”  its  output  to  zero  after  a  certain  amount 
of  time  (to  be  specified  later)  has  elapsed  without  re¬ 
establishing  communication.  The  reason  for  proposing 
a  zero-order  hold  with  such  a  feature  will  become  clear 
in  the  next  section.  More  precisely,  let  U  denote  the 
space  of  admissible  inputs  to  one  of  the  systems  (e.g. 
piecewise  continuous,  Km -valued  functions).  We  define 
H  :U  x  M+  —  {oo}  x  R+  — >  U ,  with 

r  u(t)  t.  <  t.\ 

H(u(t),ti,r)  =  <  u(t\)  ti<t<ti+T  (2) 

[  0  t\  +  t  <  t 

where  t\  denotes  the  time  that  sft.f)  =  1,  s,;(t  i)  =  0.  If 
communication  with  the  ith  system  is  initiated  at  t  =  to 
and  interrupted  at  t\,  we  have: 

f  i\  iJ'i't)  te[t.0Ri) 

Ui(t )  =  <  KjXjfti)  /!</</ 1  +  r  (3) 

[  0  t\  +  T  <  t 

We  will  call  r,;  the  “reset  time”  associated  with  the 
zero-order  hold  stage  H j.  For  notational  convenience 
we  will  use  (A,;,B,;)  as  shorthand  for  the  LTI  system 
of  Eq.l;  the  triple  (A,,B,,  A',;)  will  denote  the  closed- 
loop  dynamics  of  (A,;,B,;)  with  static  feedback  gain  A}. 
Finally,  we  will  write  ( A,;,  B,:,  A,.  r,j  to  indicate  the  net¬ 
worked  feedback  system  whose  zero-order  hold  stage 
(defined  in  Eq.2)  has  a  reset  time  of  r,;. 

2.1  Network  allocation  and  Communication  Se¬ 
quences 

In  the  setting  we  have  just  described,  the  remote  con¬ 
troller  (s)  must  choose: 

•  which  of  them  will  communicate  with  their  corre¬ 
sponding  system  (s)  at  a  particular  time 

•  how  long  communication  should  take  place  before 
a  different  set  of  feedback  loops  should  be  closed. 

The  above  remarks  motivate  the  following  definition: 

Definition  1  Consider  a  collection  of  N  LTI  systems 
with  limited  communication  where  at  most  k  <  N  of 
the  systems  can  simultaneously  communicate  with  their 
controller (s).  A  T -periodic  network  allocation  se¬ 
quence  7 t  =  {Asi , ...,  Asjv}  is  a  choice  of  N  time  in¬ 
tervals  of  length  As,;  >  0  with  As,;  <  T,  As,;  =  k.T . 
As,;  corresponds  to  the  length  of  time  during  which  the 
ith  system  communicates  with  its  controller  during  ev¬ 
ery  period.  Given  a  T-periodic  network  allocation  se¬ 
quence,  7 t  =  {Asi, ...,  Asjv}  we  can  compute  the  time 
intervals  during  which  the  ith  feedback  loop  is  closed. 

i— 1  i 

xij(t)  =  [jT+Yl  AskJT+Yl As*);  j  =  (4) 

0  0 


Moreover,  one  can  show  that  there  is  a  corresponding 
sequence  of  operations  for  the  switches  s,:  so  that  the  ith 
system  closes  its  loop  for  As,:  units  of  time  during  every 
interval  of  duration  T,  without  violating  the  constraint 
As,:  <  k.T .  Equivalently,  Card{i  :  t  G  (J jT-ij}  < 
k,Vt.  We  will  limit  our  discussion  to  periodic  communi¬ 
cation,  although  one  can  consider  the  problem  without 
this  restriction  (see  for  example  [5]).  Periodic  commu¬ 
nication  ensures  that  disturbances  in  a  system  will  not 
grow  too  large  between  communication  events.  We  can 
now  state  the  problem  we  are  concerned  with: 
Problem  Statement  1  Consider  a  collection  of  LTI 
systems  (  .1,.  /!,).  i  =  1, ..., TV,  with  a  choice  of  stabi¬ 
lizing  feedback  laws  Uj,  =  KiXi.  If  no  more  than  k  of 
those  feedback  loops  can  be  closed  at  any  time ,  find  a 
T-periodic  network  allocation  sequence  which  preserves 
the  stability  of  the  collection. 

A  stabilizing  network  allocation  sequence  is  still  sta¬ 
bilizing  if  we  re-order  its  elements.  Once  an  order¬ 
ing  is  chosen,  a  network  allocation  sequence  defines  a 
set  of  continuous-time  communication  sequence  <7,:  (7) 
of  times  at  which  the  switches  s,:(t)  transition  from 
0  to  1  and  vise  versa2.  For  example,  if  k  =  1, 
N  =  2  then  a\{ 7)  =  {0,Asi,T,T  +  Asi,...}  and 
<72(7)  =  {Asi,  Asi  +  Aso ,  Asi  +  T,  As'i  4-  As'2  +  /’, ... } 
provided  that  As'i  +  A s2  <  T.  Here  we  use  the 
words  “continuous-time”  when  referring  to  a  commu¬ 
nication  sequence  in  order  to  distinguish  it  from  those 
in  a  discrete-time  context  [2] ,  [7] ,  where  communication 
events  occur  only  at  integer  multiples  of  a  common  pe¬ 
riod. 

3  Sufficient  conditions  for  stability  under 
limited  communication 

We  begin  by  focusing  on  a  single  system-member  of  the 
collection3.  Consider  Eq.l  where  without  loss  of  gener¬ 
ality  the  system  and  its  controller  are  allowed  to  com¬ 
municate  for  the  first  As  <  T  units  of  time  during  each 
interval  [jT,  (j  +  1  )T],  When  access  to  the  network  is 
“allowed”  (s(t)  =  1)  the  system  can  close  its  feedback 
loop  so  that 

x  =  (A  +  BI\)x;  t  G  [jTJT  +  As)  j  =  0, 1, ... 

Because  ( A+BK )  is  stable  by  choice  of  K,  there  exists  a 
quadratic  Lyapunov  function  Vs(x)  =  xTPx,  with  P  = 
PT  >  0  such  that  for  Q  =  QT  >  0, 

(A  +  BI<)tP  +  P(A  +  BI< )  =  -Q  <  0  => 

V.(x)  <  XsVs(x),  t  G  [jT,jT  +  As),  j  =  0, 1, ...  (5) 

2We  note  that  Prob.  1  can  be  re-stated  in  the  context  of 
continuous-time  communication  sequences.  Doing  so  would  in¬ 
troduce  additional  structure  and  would  be  more  faithful  to  the 
operational  details  of  our  model.  For  simplicity,  we  have  chosen 
to  work  with  network  allocation  times  instead. 

3 TO  simplify  the  notation,  we  will  sometimes  drop  the  subscript 
i  when  referring  to  the  parameters  of  a  system  in  the  collection 


for  some  As  Gi  ,  with 
0  >  As  >  ‘2maXj{Re(\i(A  +  BA'))}. 

We  want  to  estimate  the  (worst-case)  growth  rate  of 
V(x)  when  communication  is  interrupted  (s(i)  =  0). 
Towards  that  end,  let  us  assume  that  the  zero-order- 
hold  stage  preceding  the  system  ( A,B )  has  a  reset  time 
of  r  =  0.  When  communication  is  interrupted  (say  at 
t  =  tint )  then  H  =  H(u(t),tint,  0),  u  =  0  and  the  system 
is  governed  by  its  (unstable)  open-loop  dynamics.  We 
can  obtain  an  upper  bound  on  the  growth  of  V  (;r)  from 

x  =  Ax;  t.  G  [jT  +  As,  jT  +  T)  j  =  0,1,... 

while  at  the  same  time 

V(x)<XuV(x);  t  G  [jT  +  As,jT  +  T)  j=  0,1,... 

(6) 

for  some  A.u  >  2maXi{Re(Xi(A))}  >  0.  Notice  that  if 
we  define  R  =  ATP  +  PA  then  we  have  the  inequalities 

0  >  Xs  >  max{X(Qj) / min(X(P))  (7) 

Xu  >  max(X(R)) / min(X(P))  >  0  (8) 

The  bounds  for  the  decay  and  growth  rates  As ,  A„  sug¬ 
gested  by  (7), (8)  might  be  conservative,  depending  on 
how  we  choose  P.  The  following  result  gives  a  suffi¬ 
cient  condition  on  the  amount  of  time  a  system  must 
spend  periodically  closing  its  feedback  loop  in  order  to 
preserve  its  stability. 

Observation  1  Consider  a  networked  LTI  system  de¬ 
scribed  by  (A,B,K,  0),  with  A  +  BK  stable.  LetV(x)  = 
xTPx,P  =  PT  >  0  be  a  Lyapunov  function  for  the 
closed-loop  system  satisfying  (A  +  BK)T P  +  P(A  + 
BK)  <  A SP  <  0  when  communication  is  available  (feed¬ 
back  loop  closed)  and  AT P  +  PA  <  X UP  otherwise. 
Then  the  LTI  system  is  stable  under  the  T-periodic  net¬ 
work  allocation  sequence  7  =  {As}  if 

XsAs  +  A U(T  —  As)  <  0,  or  equivalently 
T  >  As  >  XuT  (9) 

^ U 

Proof.  The  result  follows  by  considering  that  for  j  = 
0,1,...  we  have  V(x(jT  +  As))  <  ex‘AsV(x(jT ))  and 
V (x(jT  +  T))  <  eM(T-A s)V(x(jT  +  A))  ■ 

A  related  result  for  so-called  asynchronous  dynamical 
systems  can  be  found  in  [5]. 

3.1  The  effect  of  zero-order-hold  (r  >  0) 

The  bound  given  by  (9)  is  conservative  because  it  ap¬ 
plies  even  when  r  =  0,  i.e.  the  actuators  of  the 
linear  system  are  turned  off  during  periods  of  non¬ 
communication.  We  can  obtain  a  smaller  lower  bound 
for  As,:  by  examining  the  case  where  r  >  0,  i.e.  a  zero- 
order  hold  is  applied  for  r  units  of  time,  absent  commu¬ 
nication. 


Theorem  1  Consider  a  collection  of  N  networked  LTI 
systems  i .  1 ; .  / >’; .  K , .  r, ) .  with  (.4,;  +  BiKf)  stable,  whose 
feedback  loops  can  be  closed,  k  <  N  at  a  time. 

IfVi(x)  =  xT PjX  are  Lyapunov  functions  satisfying 
Vi  <  X SiVi  <  0  (when  the  ith  feedback  loop  is  closed) 
and  1)  <  X„  \ )  (ith  feedback  loop  open)  then  there  is  a 
T-periodic  allocation  sequence 

7 t  =  {Asi, A sn}  which  preserves  the  stability  of  all 
N  systems  if 

T>Asi>\i(T~fl)  (10) 

ASi 


Ti 

where  Mi(t ) 


XUi  ( T  —  Ti) 
.  .  XUi  XSi 

/— I 


<  k.T 


(11) 


=  mint{t  :  max{X(Mi(t, ))}  =  0}  (12) 

=  (I  +  fg  e~Aia daBiKi)T eA^ PieAit (I  4- 


fo  e~Aia doBiKi)  —  Pi 

Proof.  Without  loss  of  generality,  let  t  =  0  be  the  time 
when  communication  between  the  ith  system  and  its 
controller  is  interrupted.  Then,  1)(0-)  >  0,  V)(0“)  <  0. 
For  t  >  0  the  system  evolves  according  to 


x  i  —  jA  j  X  j  4-  It  >  h  i  x ;  ( 0 ) 
or  (dropping  the  subscripts  for  simplicity) 

x  =  (A  +  BK)x  -  BKe ;  e(t)  =  x(t)  -  x(0) 


3.2  Stability  with  guaranteed  convergence  rates 

Returning  to  Th.  1,  given  A s,;,  XSi ,  \Ui  for  each  system, 
the  rate  of  decay  of  the  sequence 
ViUiUT)),  j  1.2 .  /'  1 . V  will  be 

Ti  <  As  jXsi  +  (T  -  ft  -  Asi)Xu.i  (16) 

The  rate  r,;  can  take  on  any  value  in  [ASi,  (T  —  r,)A„;.j. 
where  the  upper  bound  of  that  interval  assumes  the  ith 
system  has  a  chance  to  close  its  loop  at  least  once  dur¬ 
ing  [jT,  ( j  +  1  )T),  for  an  arbitrarily  short  time.  We  can 
now  consider  a  scenario  where  each  system  “requests” 
sufficient  network  time  to  achieve  a  desired  rate  of  con¬ 
vergence,  r,:  for  the  samples  \  ',(./•,  (./  /  !!.  This  rate  can 
be  viewed  as  a  quantitative  measure  of  the  quality  of 
service  provided  by  the  network  to  a  dynamical  system. 


Corollary  1  Consider  a  collection  of  N  networked  LTI 
systems  ( .1,.  If.  /\',.  r,  i.  with  ( .  1;  ••  B,l\ , )  stable,  whose 
feedback  loops  can  be  closed  k  <  N  at  a  time.  Let  r,; 
be  given  by  Eq.12.  If  Vi(x)  =  xT Ppr  are  Lyapunov 
functions  such  that  V)  <  XSi\ )  <  0  (ith  loop  closed) 
and  I)  <  XUiVi  >  0  (ith  loop  open)  then  there  is  a  T- 
periodic  allocation  sequence  7 t  =  {Asq , ...,  Asjv}  which 
preserves  the  stability  of  all  N  systems  arid  guarantees 
that  the  sequences  Vi(xi(jT ))  decay  with  rates  r,;  <  0 
over  each  period,  provided  that 


Because  e  is  continuous  on  some  interval  [0  ,t')  (where 
at  t'  communication  is  next  restored),  V(x(t))  is  differ¬ 
entiable  on  [0,f'),  therefore  V  cannot  reverse  its  sign 
instantaneously.  We  conclude  that  V(x)  will  continue 
to  decrease  for  some  time  before  it  begins  to  increase 
again.  In  particular,  there  will  be  a  shortest  time  r  >  0 
at  which 

V{x(t))  =  x(0)Px(0)  (13) 

i.e.  xT(0 )(/  +  fg  e~AiCr daBK)T eATf PeAt(I  + 

fl  e~Aia daBK)x(0)  =  xT(0)Px(0) 

Let  M(t )  =  (I  +  f0e~Aiad(jBK)TeATtPeM(I  + 

j;|  e~AiadoBK )  -  P .  and 

r  =  mintiXpo){t  :  xT (0)M(t)x(0)  =  0}  (14) 

f  =  mint{t  :  max{X(M(t ))}  =  0}  (15) 

if  t  <  f,  then  for  all  x(0),  we  have  V(x(t ))  <  V(x(0)). 
Using  Obs.  1  we  see  that  if  ?  is  used  as  a  reset  time 
for  H,  then  the  evolution  of  V(x(t))  over  one  pe¬ 
riod  will  satisfy  V (x(T))  <  e^T~T~A‘ Any (X(AS))  < 
e^T~T~As^'a eA‘XuV{x(0))  from  which  the  sufficient 
condition  for  the  stability  of  all  N  systems  follows.  ■ 

Note  that  we  chose  to  “reset”  u  to  zero  after  a  speci¬ 
fied  time  because  holding  a  value  of  u  for  too  long  might 
make  matters  worse  for  stability,  raising  V(x)  over  what 
it  would  be  if  u  =  0.  On  the  other  hand,  we  are  guaran¬ 
teed  that  if  a  feedback  loop  is  opened  at  t  =  tint ,  V  (x) 
will  not  grow  larger  than  V(x{tint))  for  another  f  units 
of  time,  as  long  as  u(t)  =  u(tint). 


a  XUi  (T  -  n)  -  nT 


Qi  = 


A,/..  Xa 


<  T ;  i  =  l,...,N 


N 

<kT 

i= 1 


3.3  Finding  a  suitable  Lyapunov  function 

The  utility  of  the  bounds  in  Th.  1  and  Cor.  1  depends 
on  our  estimate  of  the  decay /growth  rates  XSi,XUi  for 
the  Lyapunov  functions  V)  =  ./•,  P,x,.  If  Pi  are  not 
carefully  chosen,  the  inequalities  (7), (8)  can  give  con¬ 
servative  results  for  As,;  so  that  a  system  unnecessar¬ 
ily  demands  almost  constant  communication.  To  avoid 
this  situation,  we  would  like  to  find  quadratic  Lyapunov 
functions  for  which  the  the  decay/growth  rates  XSi,XUi 
are  as  small  as  possible  (keeping  in  mind  that  XSi  <  0). 
The  inequalities  (10), (11)  suggest  solving  the  following 
problem: 

T  (  t^v) 

subject  to 

(.4  +  BK)tP  +  P(A  +  BK) 

AtP  +  PA 
P  >  0,  As  <  0,  A„ 


<  A  SP  (17) 

<  XUP  (18) 

>  0  (19) 


Observation  2  The  preceding  problem  is  equivalent  to 
minimizing  c=  —Xu/Xs  subject  to  (17)-(19). 


Proof.  Minimizing  j  is  equivalent  to  maximizing 
the  inverse  quantity,  which  is  equivalent  to  minimizing 
-Au /A s  >  0.  ■ 

We  can  thus  parameterize  Xu  =  —c\s  with  c  >  0  and 
instead  solve  the  following: 

Problem  Statement  2  Given:  A,  B ,  K ,  Minimize 

c  >  0  over  all  P  =  PT  >0,  Xs  <  0,  subject  to: 

(A  +  BK)tP  +  P(A  +  BI\)  <  X  SP 

AtP  +  PA  <  —cXsP  (20) 
P  >  0,  As  <  0,  c  >  0 

In  this  problem  we  are  minimizing  a  linear  function  sub¬ 
ject  to  the  given  inequalities,  therefore  we  expect  the 
minimum  to  be  achieved  at  the  boundary  of  the  feasible 
region.  We  observe  that  the  inequalities  (20),  viewed 
in  the  space  (P,Xs,c),  are  linear  in  each  variable  after 
fixing  the  other  two.  Notice  that  if  (P,  As,Ci)  satisfy  the 
inequalities  then  so  do  (P,Xs,c)  for  all  c  >  c\.  Also,  if 
the  inequalities  cannot  be  satisfied  for  some  c  =  Co ,  then 
they  cannot  be  satisfied  for  any  other  c  <  Co.  There¬ 
fore  the  minimum  in  Prob.2  will  be  the  unique  value  of 
c  =  c*  >0  such  that  (20)  has  a  solution  for  c  >  c*  but 
not  for  c  <  c*.  This  observation  allows  us  to  find  the 
global  minimum  c*  using  bisection  for  the  parameter  c, 
where  at  each  step  we  compute  a  feasible  solution  to  (20) 
which  form  a  set  of  bilinear  matrix  inequalities  (in  As 
and  P )  [1],  [4j.  The  latter  problem  can  be  solved  glob¬ 
ally  using  a  branch  and  bound  technique  as  suggested 

4  Simulation  Results 

We  simulated  a  group  of  three  ( N  =  3)  unstable  linear 
systems  which  can  communicate  two  at  a  time  (k  =  2) 
with  three  remotely-located  controllers.  The  communi¬ 
cation  period  was  T  =  3sec.  To  simplify  matters,  all 
three  systems  are  governed  by  the  same  dynamics: 

X'i  =  Axi  +  Bui]  u.i  =  h.ij,  i  =  1,2,3  (21) 

with 

■4=[l.“  -0.1  ]■’  S  =  I011T' 


three  systems,  closing  no  more  than  two  of  the  three 
feedback  loops  at  any  one  time.  Using  the  above  values 
for  P,  A,  B,  K ,  we  computed  (from  Eq.  12)  f,  =  0.72seo. 
This  suggests  that  when  communication  is  interrupted 
(say  at  t  =  tint )  and  the  zero-order  hold  is  activated,  our 
Lyapunov  function  has  not  surpassed  its  value  at  tint  un¬ 
til  another  0.72sec  have  elapsed.  From  this  fact  together 
with  Eq.10,  we  obtained  a  new  bound  of  As,  >  1.23sec 
as  a  sufficient  communication  time  (every  T  =  3 sec)  for 
stabilizing  each  system.  Equivalently,  the  system(s)  can 
tolerate  a  communication  disruption  for  at  least  1.77sec, 
or  59%  of  the  communication  period.  These  numbers 
are  to  be  compared  with  those  given  by  the  sufficient 
condition  in  [10]  by  which  an  interruption  of  less  than 
t1  =  0.173 sec  is  required  to  guarantee  stability  for  the 
same  systems.  Figure  2  shows  the  evolution  of  the  Lya¬ 
punov  functions  Vi(xj)  =  xf  PjxJ  for  each  of  the  three 
systems,  each  starting  from  a  different,  randomly  cho¬ 
sen  initial  condition.  The  switching  functions  s,;  show- 


Communication  Sequence  (N=3,  k=2) 


Figure  2:  Top:  Time  evolution  of  the  Lyapunov  function  of 
each  system.  Bottom:  The  corresponding  com¬ 
munication  sequence. 


the  open  loop  eigenvalues  being  1.17,-1.27.  The  con-  ing  when  communication  with  the  ith  system  was  taking 
trailers  =  [—35,  —29]  were  designed  to  place  the  place  are  plotted  in  Fig. 2,  scaled  by  an  integer  factor  of 

closed  loop  eigenvalues  of  each  system  (A,;  +  B,:A,)  at  { t0  make  them  easily  distinguishable  from  one  another. 

—  1,  —2.  We  solved  the  minimization  problem  of  Sec.  3.3  As  expected,  there  are  at  most  two  non-zero  indicator 

(Prob.  2)  and  found  Xs  =  —  2.00,  A„  =  2.35,  c*  =  1.17  functions  at  any  one  time.  Also,  there  are  time  intervals 

where  only  one  feedback  loop  is  closed.  This  indicates 
that  there  is  “room”  for  guaranteeing  a  faster  rate  of 
convergence. 

giving  a  network  allocation  sequence  with  As,;  >  1.62sec 

for  each  system  (i.e.  7 t  =  {1.62,1.62,1.62}).  Because  4.1  Stability  with  guaranteed  convergence  rates 

E,:  A«i  <  kT  =  6,  there  exists  a  periodic  communica-  Using  the  same  setup  as  in  the  previous  section,  we 

tion  sequence  that  preserves  the  stability  of  each  of  the  now  ask  that  the  three  systems  converge  with  rates 


r\  =  —.5,  ro  =  —1,  r3  =  —1.5,  in  the  sense  that 
Vj(xi(jT  +  T))  <  eriVj(x(jT)).  Using  the  results  of 
Cor.  1,  we  obtained  a  new  network  allocation  sequence 
with  Asi  =  1.57,  As2  =  1.91,  As3  =  2.26.  In  this  case, 
Y  A  Si  =  5.74  which  is  closer  to  the  limit  of  available 
network  time.  If  we  did  not  choose  to  take  into  account 
the  effects  of  the  zero-order  hold  stage  (i.e.  r*  =  0) 
then  the  worst-case  analysis  gives  Asq  =  1.97,  As2  = 
2.31,  As3  =  2.66  which  sum  to  6.94  >  kT  =  6  and 
our  criterion  would  fail  to  indicate  that  there  exists  a 
communication  sequence  that  stabilizes  all  3  systems. 
Figure  3  shows  the  evolution  of  the  Lyapunov  function 
for  each  of  the  three  systems,  starting  from  the  same 
initial  conditions  used  in  the  previous  simulation.  The 


Communication  Sequence  (N=3,  k=2) 


Figure  3:  Systems  2  and  3  have  faster  guaranteed  conver¬ 
gence  rates  resulting  from  the  allocation  of  more 
network  time  to  them. 

time  plot  of  the  communication  sequence  i  ■  s$(t)  (again 
scaling  Sj  by  i)  shows  significantly  higher  utilization  of 
the  available  time.  Note  that  the  bound  of  (10), (11)  is 
conservative,  in  the  sense  that  the  actual  decay  rates 
observed  are  significantly  faster  than  those  guaranteed. 

5  Conclusions  and  Future  Work 

We  have  proposed  a  model  for  groups  of  dynamical  sys¬ 
tems  whose  feedback  loops  are  closed  via  a  shared  net¬ 
work,  and  explored  the  problem  of  finding  network  allo¬ 
cation  sequences  (and  their  corresponding  communica¬ 
tion  sequences)  that  preserve  the  stability  of  all  systems 
on  that  network.  The  presence  of  communication  con¬ 
straints  was  modeled  by  assuming  that  the  network  can 
accommodate  only  a  few  controller/plant  communica¬ 
tions  at  any  one  time.  Each  system’s  feedback  controller 


was  designed  without  considering  the  effects  of  the  net¬ 
work.  We  gave  a  sufficient  condition  for  the  existence  of 
network  allocation  sequences  that  preserve  the  stability 
of  the  collection  and  showed  how  such  sequences  can  be 
chosen  to  minimize  the  amount  of  communication  nec¬ 
essary  for  stability.  Our  analysis  has  taken  into  account 
the  effects  of  zero-order  hold  applied  at  the  input  of  each 
system  when  communication  is  not  possible.  Although 
our  results  are  conservative,  they  represent  a  significant 
improvement  over  previous  estimates  for  the  amount  of 
communication  required  to  guarantee  stability. 

Opportunities  for  further  work  include  the  joint  selec¬ 
tion  of  the  communication  sequence  and  feedback  gains, 
use  of  time-varying  reset  intervals  in  a  system’s  zero- 
order  hold  stage,  and  augmenting  the  basic  model  to 
include  dynamic  interactions  between  systems  in  addi¬ 
tion  to  the  coupling  introduced  by  the  presence  of  com¬ 
munication  constraints. 
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